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The  created  response  surface  technique  was  applied  to  structural 
optimization  with  multiload  conditions.  The  constrained  optimization 
problem  was  converted  to  an  unconstrained  problem  by  the  use  of 
penalty  functions  which  varied  inversely  with  the  distance  of  the 
design  point  from  a  constraint.  Response  surfaces  were  also  introduced 
for  optimization  with  discrete  variables.  The  Rosenbrock  Method  of 
unconstrained  optimization  was  used.  The  original  method  was  modified 
to  take  advantage  of  the  interaction  between  the  optimization  procedure 
and  the  response  characteristics  of  the  structure.  This,  when  coupled 
with  the  r  extrapolation  procedure,  resulted  in  considerable  savings 
in  computing  time.  A  pilot  computer  program  was  developed,  and  case 
studies  of  truss-type  structures  were  made. 
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SECTION  I 
INTRODUCTION 


The  basic  approach  to  the  problem  of  elastic  structural  optimization  as  a  constrained 
minimization  was  presented  by  Schmit  (Reference  1)  in  1960.  The  concepts,  which  are  based 
upon  the  combination  of  methods  of  automatic  structural  analysis  and  operations  research, 
are  now  well  known.  The  original  methods,  which  are  only  strictly  usable  for  small  scale 
structures,  have  been  subjected  to  considerable  development  and  are  now  applicable  to  realistic 
large  scale  structures  (References  2  and  3). 

In  order  to  solve  the  constrained  optimization  problem,  a  design  space  approach  has  been 
developed.  The  coordinates  of  the  space  are  the  variables  in  the  structure  to  be  optimized. 
Within  the  space,  a  number  of  surfaces  are  defined  to  correspond  to  constraint  conditions  and 
a  merit  function.  The  merit  function  is  frequently  the  weight  of  the  structure  but  other  criteria 
may  also  be  used.  Using  the  nonlinear  mathematical  programming  techniques  reviewed  later, 
the  minimum  value  of  the  merit  function  is  sought,  subject  to  the  prescribed  constraints  on  the 
response  characteristics  of  the  system.  Generally,  the  cross-sectional  areas  and  geometric 
configuration  form  the  design  variables  while  the  constraints  are  limits  on  stresses  and  dis¬ 
placements.  When  appropriate,  additional  classes  of  design  variables  and  constraints  may  be 
used. 

Although  this  approach  has  been  developed  and  used  for  large  scale  optimizations,  there 
are  certain  limits  to  the  scope  and  range  of  economic  applicability.  In  effect,  these  limitations 
restrict  the  use  of  the  constrained  optimization  approach  to  cases  in  which  the  merit  criterion 
is  a  linear  function  of  the  design  variables.  This  limit  generally  implies  that  only  material 
thicknesses  and  cross-sectional  areas  can  be  treated  as  variables  and  that  all  configuration  and 
geometry  must  be  fixed.  For  nonlinear  merit  functions,  the  search  methods  are  less  efficient, 
and  computational  expense  can  become  prohibitively  large. 

To  overcome  these  restrictions,  a  modified  approach,  the  unconstrained  approach  is 
necessary  to  the  problem.  Since  the  natural  expression  of  the  structural  optimization  problem 
is  a  constrained  minimization,  the  representation  in  an  unconstrained  form  requires  some 
mathematical  reformulation.  To  accomplish  this,  so-called  penalty  functions  are  defined  that 
account  for  nonsatisfaction  of  the  constraint  conditions.  The  penalty  function,  which  is 
continuous  with  continuous  derivatives,  is  weighted  and  added  to  the  basic  merit  or  objective 
function  to  form  a  “created  response  surface”.  For  each  value  of  the  weighting  factor,  a  com¬ 
plete  continuous  response  surface  exists  whose  minimum  may  be  found  using  unconstrained 
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search  techniques.  By  successive  reductions  of  the  weighting  factor,  a  series  of  minima  is 
determined  whose  limit,  when  the  weighting  factor  vanishes,  provides  the  constrained  minimum 
of  the  basic  merit  function  only.  This  approach  was  originally  proposed  by  Carroll  (Reference  4), 

By  using  the  reformulated  unconstrained  minimization  approach,  a  great  degree  of 
generality  is  achieved  in  the  definable  classes  of  design  variables.  The  only  restriction  that 
is  still  applicable  is  that  the  variables  be  continuous  functions.  In  many  classes  of  structures, 
e.g.  space  frames  fabricated  from  standard  sections,  the  assumption  of  continuous  variation 
of  property  is  inappropriate.  A  method  for  considering  discrete  variation  is  required. 

Toakley  (Reference  5)  in  a  paper  dealing  with  minimum  weight  plastic  design,  considered 
discrete  sections  using  three  different  methods.  Since  the  methods  of  limit  analysis  were  used, 
the  problem  reduced  to  a  purely  linear  one.  The  methods  used  are  not  applicable  to  the  present 
totally  nonlinear  regimes.  Within  the  framework  of  the  created  response  surface,  a  technique 
has  been  developed  that  will  permit  the  use  of  discrete  variables.  Effectively,  the  introduction 
of  discrete  sections  into  the  design  process  is  equivalent  to  the  specification  of  a  multiplicity 
of  equality  constraints.  That  is,  a  variable  must  be  equal  to  one  of  a  prescribed  list  of  values. 
To  effect  this  an  additional  penalty  function  is  introduced  into  the  unconstrained  minimization 
process.  The  new  function  will  vanish  only  when  equality  conditions  are  satisfied  and  will  be 
nonzero  at  all  other  points.  By  weighting  this  function  in  an  appropriate  manner  the  optimiza¬ 
tion  process  can  be  made  to  converge  on  the  discrete  values, 

Melosh  and  Luik  in  Reference  6  have  developed  an  efficient  reanalysis  method  using 
self-equilibrating  stress  systems.  This  was  combined  with  an  allocation  procedure  to  optimize 
trusses  with  discrete  or  continuous  section  properties. 

More  recently,  Schmit  et  al.  in  Reference  7  have  applied  the  unconstrained  minimization 
method  to  study  integrally  stiffened  cylindrical  shells. 

A  small  scale  optimization  program  has  been  developed  using  the  unconstrained  approach 
with  the  capability  of  including  discrete  sections.  Results  obtained  using  this  program  are 
included  along  with  a  description  of  the  unconstrained  techniques. 

Before  proceeding  to  a  detailed  presentation  of  the  unconstrained  minimization  methods, 
a  brief  discussion  of  the  constrained  problem  is  given. 
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SECTION  II 
OPTIMIZATION 


CONSTRAINED  OPTIMIZATION 

The  general  constrained  optimization  problem  may  be  expressed  in  a  strictly  mathematical 
form. 

It  is  required  to  find  the  values  of  the  variables  a2  •  •  •  an  suc^  that  function 

f  (a-  a„  .  a  )  has  a  minimum  value  subject  to  satisfaction  of  the  p  constraint  conditions. 

'  1  2  n# 

(a,  ,a2  •  •  •  0  '  *  z.  P  "> 

The  function  f  may  be  the  weight  of  the  structure  and  the  functions  g\  the  stresses  and  displace¬ 
ments  which  must  be  less  than  prescribed  values  k.. 

In  order  to  discuss  the  method  of  solution,  it  is  convenient  to  use  a  simple  geometric 
representation  of  the  problem.  A  design  space  is  defined  in  which  each  dimension  represents 
a  variable.  For  graphical  purposes  it  is  necessary  to  limit  this  to  two  or  three  dimensional 
space;  but  in  the  general  problem  with  n  variables,  an  n-dimensional  hyperspace  must  be 
defined.  Since  mathematical  processes  developed  for  the  two  or  three  dimensional  spaces  are 
applicable  to  the  higher  order  spaces,  only  the  simple  three  dimensional  case  need  be  dis¬ 
cussed.  If  attention  is  restricted  to  designs  in  which  the  configuration  and  geometry  are  fixed 
and  only  one  cross-sectional  dimension  for  each  element  is  variable,  the  weight  is  a  linear 
function  ofthese  variables.  Then  all  designs  of  a  given  weight  lie  on  a  plane  in  three  dimensions 
(Figure  la).  In  higher  order  spaces,  the  function  is  still  linear  and  corresponds  to  a  hyper¬ 
plane.  For  every  weight,  such  a  linear  function  exists  and  hence  all  possible  weights  can  be 
represented  by  a  family  of  parallel  lines  or  planes. 

In  general  the  constraint  conditions,  Equation  1,  are  nonlinear  functions.  The  equality 
conditions  will  be  represented  by  curved  surfaces  in  the  design  space  shown  in  Figure  lb. 
For  each  of  the  p  constraints,  a  surface  will  exist.  These  surfaces  are  generally  convex  when 
viewed  from  the  origin.  The  dominant  portions  combine  to  form  a  composite  constraint  surface 
as  indicated  in  Figure  lc.  This  surface  then  provides  the  boundary  between  the  regions  of  the 
space  in  which  a  design  is  acceptable  (inequality  of  Equation  1  is  satisfied)  and  is  unacceptable 
(inequality  not  satisfied).  Since  the  nearer  a  weight  surface  is  to  the  origin,  the  lower  the 
weight;  the  minimum  weight  acceptable  design  will  occur  when  a  weight  surface  touches  the 
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composite  constraint  at  one  point  only  ( Figure  Id) .  The  processes  of  determining  this  oscillatory 
point  can  now  be  reduced  to  the  definition  of  a  suitable  travel  path  through  the  design  space 
from  some  arbitrary  starting  point  until  the  optimum  is  reached.  Each  step  along  this  path 
involves  a  change  in  the  variables  and  hence  a  redesign  of  the  structure.  Analyses  are  per¬ 
formed  at  each  step  to  provide  information  for  the  size  and  direction  of  future  steps.  In  one 
approach  (Reference  2)  two  modes  of  travel  are  used  to  determine  the  optimum  point,  steepest 
descent  and  side  step.  In  the  steepest  descent  mode,  the  weight  is  reduced  in  the  most  rapid 
fashion  until  a  constraint  surface  is  met.  The  object  of  the  next  stage  of  redesign,  the  side 
step,  is  to  move  to  a  point,  as  far  as  possible,  away  from  the  constraint  surface  from  which  a 
new  steepest  descent  may  be  initiated.  This  step  is  performed  at  constant  weight.  Details  of 
this  approach,  including  methods  of  determining  constraint  derivatives,  are  presented  in 
Reference  2. 

If  additional  variables  are  introduced  to  make  the  merit  function  nonlinear,  it  can  be  seen 
that  the  above  method  is  no  longer  strictly  applicable.  Travel  orthogonal  to  the  merit  function 
would  be  along  a  curved  path,  requiring  continuous  recomputation  of  the  directions.  A  modified 
version  of  this  approach  has  been  developed  for  nonlinear  merit  functions  (Reference  3)  but 
it  has  become  apparent  that  the  unconstrained  formulation  is  more  efficient  and  has  greater 
potential, 

UNCONSTRAINED  OPTIMIZATION 

The  constrained  minimization  requires  the  determination  of  the  lowest  value  of  some 
function  for  which  no  mathematical  minimum  may  be  found,  within  a  region  bounded  by  pre¬ 
scribed  constraint  conditions,  In  the  unconstrained  approach  a  combined  continuous  merit 
function  is  defined  to  replace  the  original  separate  merit  and  constraint  functions.  With  this 
new  single  function,  both  the  basic  merit  function  and  the  constraints  are  approximated  within 
the  feasible  region.  By  suitable  adjustment  of  an  arbitrary  weighting  factor,  the  combined 
function  can  be  made  to  approximate  the  basic  merit  as  closely  as  desired  until  in  the  limit  the 
desired  minimum  is  found.  To  perform  this  transformation  a  so-called  penalty  function  is 
created.  This  penalty,  which  is  weighted  by  an  arbitrary  scalar,  and  combined  with  the  basic 
merit  function,  accounts  for  the  nonsatisfaction  of  the  constraint  conditions.  In  a  given 
structural  problem, 

DV.  =  design  variables  i  =  1,  2,  .  ,  .  ^ 

BFjk=  jth  response  characteristic*  of  the  structure  under  the  kth  loading  condition 
j  =  1,  2,  .  .  .  m,  k  =  1,  2,  ,  .  .  n 

U,  L  =  Superscripts  denoting  upper  and  lower  limiting  values  (i.e.  constraint  conditions) 


*  Response  characteristic  is  taken  here  to  mean  critical  stress,  displacement  or  any  other 
measurable  response  of  the  structure  to  the  loading  system. 
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Then  a  penalty  function  Pc  due  to  the  constraint  conditions  on  both  design  variables  and  response 
functions  is  defined  by 


pc 


Y  (dvu-dv.L) 

i  =  I  '  * 


I 


DV.U  -DV. 


i 


i 


DV.  -DV.L 

t  i 


+ 


I 


j  =  l 


m 

I 

k  =  l 


(BF. 


jk 


- ! -  + - ! - 

BFU  -BF  BF  -BFl 
jk  jk  jk  jk 


(2) 


Since  the  various  design  variables  and  behavior  functions  can  take  on  values  of  differing  orders 
of  magnitude,  it  is  necessaryto  introduce  scaling  factors  to  ensure  that  each  component  of 
the  summation  has  an  approximately  equal  contribution  to  the  total  penalty.  The  total  permissible 
range,  e.g.  (DV,U-DV.L),  for  each  characteristic  is  used  as  this  factor.  It  can  be  seen  that 
this  penalty  function  will  tend  to  infinity  when  any  constraint  condition  is  satisfied  but  each 
term  diminishes  rapidly  at  some  distance  from  a  constraint.  To  obtain  the  total  function  that 
will  be  used  in  the  unconstrained  optimization,  the  above  penalty  is  weighted  by  an  arbitrary 
factor  and  added  to  the  basic  merit  function  W. 


The  total  function  is  then  written  as 

F  =  W  +  rc  Pc 


(3) 


Figure  2.  Unconstrained  Minimization  Penalty  Functions 
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Figure  3.  Created  Response  Surfaces 

The  effect  of  this  summation  is  to  create  a  family  of  response  surfaces,  which  will  lie 
in  the  nonviolated  region  of  the  design  space  and  will  be  bounded  by  the  composite  constraint 
surface.  This  approach,  basically  attributable  to  Carroll  (Reference  4),  is  known  as  the  Created 
Response  Surface  Technique. 

The  physical  meaning  of  these  surfaces  may  be  presented  graphically  as  in  Figures  2  and 

3.  In  the  figures  the  horizontal  axis  represents  the  design  variables  whereas  the  vertical 

direction  represents  the  total  value  of  the  penalty  function  Equation  3.  The  basic  merit  function 

W  is  some  simple  (monotonic)  function  of  the  design  variables  and  it  has  a  lowest  value  of  L 

corresponding  to  some  constraint  condition.  The  basic  penalty  P  in  Equation  2  has  the  general 

c 

form  of  a  rectangular  hyperbola  having  both  he  constraint  condition  and  the  horizontal  axis 
as  aymptotes.  By  introducing  the  weighting  factor  rtf  a  family  of  hyperbolas  is  created.  Com¬ 
bining  these  hyperbolas  with  W,  Equaion  3  yields  the  series  of  curves  (surfaces)  of  Figure  3. 

Each  curve  of  the  family  exhibits  a  unique  minimum.  With  decreasing  values  of  r  these  minima 

c 

approach  the  lowest  value  L  until,  in  the  limit  as  r  tends  to  zero,  the  value  L  is  actually 

c 

achieved.  The  successive  minima  of  the  created  response  surfaces  are  determined  by  uncon¬ 
strained  search  techniques. 
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With  this  approach,  the  precise  nature  of  the  basic  merit  function  (linear  or  nonlinear) 
is  immaterial  to  the  optimization  process.  Hence,  the  method  has  an  almost  unlimited  range  of 
applications. 

Before  proceeding  to  discussion  of  the  search  techniques  used,  it  is  appropriate  to 
introduce  the  discrete  variables  problem  at  this  stage. 

OPTIMIZATION  WITH  DISCRETE  VARIABLES 

In  the  vast  majority  of  structure,  fabrication  requirements  will  demand  that  some  com¬ 
ponents  be  standard  sections  for  which  the  properties  cannot  be  regarded  as  continuously 
variable. 


To  produce  many  components  (e.g.  rolled  steel  sections)  in  sizes  other  than  the  standard 
ranges  are  normally  prohibitively  expensive.  Therefore,  although  a  true  optimum  structure 
(on  a  weight  or  other  basis)  may  require  nonstandard  components,  economics  will  dictate 
the  use  of  the  cheaper  standard  size. 


The  original  formulation  of  the  optimization  problem  has  only  inequality  constraints, 
Equation  1.  In  the  discrete  variable  problem,  equality  conditions  are  required.  The  approach 
to  the  incorporation  of  discrete  variables  is  based  upon  Fiacco  and  McCormick’s  (Reference  8) 
extension  of  the  created  response  surface  technique  to  include  equality  constraints. 

In  order  to  incorporate  the  discrete  variables  an  additional  penalty  function  P^  is 
introduced  to  account  for  nonsatisfaction  of  the  specified  discrete  sizes. 


The  new  penalty  function  has  the  form 


i 

■  I 

i  =  I 


DVj  — DSj  j 

DS.. 

') 


where  DV.  =  current  value  of  one  of  the  £  design  variables 

DS.j  =  the  jth  allowable  discrete  value  for  the  ith  design  variable 
and  7T  indicates  a  finite  product  over  j. 


(4) 


91 


AFFDL-TR-68-150 


In  this  function,  the  product  term  will  ensure  that  each  individual  term  of  the  summation 
will  vanish  when  the  appropriate  design  variable  assumes  any  one  of  its  prescribed  discrete 
values.  As  for  the  constraint  penalty,  this  discrete  penalty  is  weighted  and  added  to  the 
combined  function,  Equation  3,  to  form  a  new  total  penalty. 

F  =  W  +  rc  Pc  +  rd  Pd  (5) 

The  weighting  factor  r  was  decreased  in  value  as  the  optimization  proceeded.  Because  of  the 

c 

different  nature  of  Pd  from  Pc>  the  weighting  factor  r^  is  increased  successively.  This  forces  the 
design  to  assume  the  discrete  values  at  which  the  penalty  vanishes.  The  effect  of  including  the 
discrete  penalty  function  can  be  illustrated  graphically  in  two  ways.  The  combined  merit  and 


Figure  4.  Discrete  Optimization  Penalty  Functions 
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Penalty 


W 


constraint  penalty  functions  are  shown  in  Figure  4.  The  function  P^  has  an  oscillatory  form, 
as  indicated  in  Figure  4,  having  minima  at  the  discrete  values  d^,  d^,  d^,  etc.  Combining  all 
functions,  a  total  response  surface  such  as  depicted  in  Figure  5  results.  Under  normal 
conditions  the  minimum  will  occur  at  a  point  such  as  D.  The  penalty  P^  does  not  take  into 
account  the  existence  of  main  constraint  conditions.  As  a  result  situations  can  arise  in  which 
the  design  reaches  the  point  P,  and  attempts  to  converge  on  the  unacceptable  discrete 
value  d^.  The  constraint  prevents  this,  but  a  nondiscrete  minimum  is  reached  near  P. 
To  correct  this  situation,  the  discrete  value  d^  is  eliminated  and  the  design  will  usually  then 
slip  into  the  minimum  at  Q  as  desired.  An  alternative  view  of  the  problem  is  obtained  in 
Figure  6.  The  coordinates  here  are  the  design  variables.  The  lines  and  C2  represent  the 
active  constraint  conditions  at  whose  intersection  the  true  minimum  lies.  For  a  particular 
value  of  rc  and  with  r^  set  to  zero,  contour  lines  for  the  created  response  surface  are  shown. 
The  minimum  lies  at  Fc,  some  distance  from  the  true  minimum.  As  r  is  reduced  the 
contours  approach  the  constraints  more  closely.  To  include  the  penalty  Pd  a  rectangular  grid 
is  superimposed.  The  lines  correspond  to  the  specified  discrete  values  of  the  variables.  The 
function  P^  adds  a  peak  on  each  rectangle  and  is  zero  at  the  intersection  points.  When  r^  be¬ 
comes  very  large,  the  design  is  forced  very  strongly  toward  these  intersections. 
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In  principle,  it  is  possible  to  start  with  any  feasible  design  and  then  to  decrease  the 
weighting  function  r  and  increase  the  weighting  function  r ,  simultaneously.  But  in  practice, 
it  is  difficult  both  to  estimate  the  initial  values  of  rc  and  r^  and  their  relative  rates  of  change 
with  progress  in  the  minimization.  In  any  case,  it  was  argued  that  the  discrete  minimum  is 
always  near  the  continuous  minimum  so  that  the  continuous  minimum  design  is  always  taken 
as  the  starting  point  for  a  discrete  design.  This  proximity  of  the  discrete  minimum  design  to 
the  continuous  minimum  design  can  best  be  seen  from  the  contour  plots  used  previously  to 
interpret  the  created  response  surface  function.  For  a  well-behaved  created  response  surface, 
function  F,  such  as  that  shown  in  Figure  6,  the  discrete  minimum  is  at  one  of  the  intersections 
of  the  rectangular  grid  that  encloses  the  continuous  minimum. 

In  a  practical  problem,  although  it  might  be  possible  theoretically  to  select  some  initial 
values  for  both  r  and  r .  and  manipulate  both  simultaneously  in  concert,  it  has  been  found 
convenient  to  ignore  the  discrete  requirements  at  first  (i.e.  r^  =  0)  until  an  optimum  design 
has  been  found  and  then  proceed  from  that  point  with  r^  increasing  in  value. 

MINIMIZATION  PROCEDURES 

To  determine  the  unconstrained  minimum  of  a  function,  a  number  of  methods  have  been 
developed  in  the  general  field  of  operations  research. 

The  choice  of  the  minimization  procedure  for  the  current  work  was  influenced  to  a  large 
extent  by  the  observation  that  the  gradient  of  the  function  F  is  not  easily  calculated  and  that 
the  created  response  surface  varies  very  rapidly  near  the  constraints.  This  reduced  the 
choice  of  methods  to  one  that  did  not  require  the  calculation  of  the  derivatives  in  closed  form. 
Fletcher  (Reference  9)  compared  the  more  promising  methods  and  results  and  suggests  that 
the  methods  of  Powell  (Reference  10)  or  Rosenbrock  (Reference  11)  would  be  suitable  for 
minimization  with  large  numbers  of  variables.  The  Rosenbrock  method  was  finally  selected 
because  experience  with  the  reliability  of  the  procedure  has  been  obtained  on  some  earlier 
problems. 

In  Rosenbrock’ s  method  some  initial  point  in  the  n-variable  space  is  selected,  n  orthonormal 
directions,  p. ,  p_  -  -  -  p  are  defined.  For  the  first  step,  these  directions  will  normally  be 
parallel  to  the  coordinate  directions.  Travel  alongthe  first  direction  is  initiated  and  continues 
in  the  direction  of  decreasing  value  of  the  response  function  until  a  minimum  (or  approximation 
thereto)  is  found.  The  total  distance  of  travel  is  designated  by  the  scalar  a  y  New  travel 
along  the  second  direction  now  takes  place,  usingthe  previous  minimum  as  a  starting  point  and 
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Figure  6.  Contour  Plot  of  Created  Response  Surface 
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this  continues  until  a  minimum  is  found.  This  is  travel  distance  a  ^  The  process  is  repeated 
for  each  of  the  n-directions  in  turn.  From  the  results  of  these  explorations  a  new  set  of  vector 
directions  q, ,  q„  .  .  .  q  are  then  constructed  so  that 


=a|Pi+o,2P2+ - +  «„P, 

=  «!»!'* - -  -  t“n  Pn 

I  I 


(6) 


The  set  of  vector  directions  q, »  q0  .  .  .  q  is  then  orthonormalized  by  the  Schmit  process  to 

i.  A  n 

give  a  new  set  of  travel  vectors  p. ,  p„  .  .  .  p  .  New  travel  may  now  be  initiated  and  the  entire 

i  ^  n 

process  repeated  until  the  optimum  is  found.  In  physical  terms,  this  can  be  regarded  as  a 
linear  extrapolation  process.  The  first  generated  vector  q^,  which  is  subsequently  normalized 
to  provide  the  first  travel  direction  p^,  is  the  vector  joining  the  initial  and  final  points  of  the 
exploration.  It  was  along  this  direction  that  the  greatest  reduction  of  the  merit  function  was 
achieved;  hence,  it  is  intended  that  further  travel  along  this  direction  would  accomplish  further 
meaningful  reductions  in  the  function. 


In  the  original  work,  Rosenbrock  proposed  a  method  of  determining  the  distance  of  travel 
a .  to  minimize  approximately  the  merit  function.  An  arbitrary  step  length  e  was  first  tried. 
If  this  reduced  the  value  of  the  function,  a  new  step  length  f3  +  €  was  taken,  where  (3  +  is 
some  scalar  greater  than  unity.  If  the  step  did  not  effect  a  reduction,  a  new  step-/3-e  was 
taken,  with  0  <  /3-<l.  In  practice,  suitable  values  selected  for  /3+  and  /3-  are  3.0  and  0.5 
respectively.  No  attempt  was  made  to  find  the  exact  minimum  in  the  chosen  direction.  Inter¬ 
polation  or  other  procedures  were  ruled  out  on  the  grounds  that  the  additional  computation 
costs  were  unnecessary,  since  the  exact  value  of  the  minimum  at  that  stage  has  little  influence 
on  the  later  search  procedure.  In  fact,  with  experience,  it  has  been  found  that  it  is  sufficient 
to  work  with  a  maximum  of  two  successful  steps  along  any  travel  direction. 
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SECTION  III 

COMPUTER  PROGRAM 


In  order  to  evaluate  quantitatively  the  effectiveness  of  the  techniques  discussed  in  the  pre¬ 
vious  section,  a  pilot  computer  program  for  the  optimization  of  small  scale  structures  has 
been  developed. 

To  minimize  the  effort  involved  in  the  development  of  a  pilot  program  a  relatively  in¬ 
efficient  analysis  module  was  selected  from  a  previously  coded  computer  program.  This 
analysis  was  limited  to  approximately  50  degrees  of  freedom  and  originally  contained  only  an 
axial  force  member  in  the  element  library.  This  was  considered  sufficient  for  initial  research. 

INITIAL  DESIGN  PARAMETERS 

The  reciprocal  nature  of  the  penalty  function  requires  that  the  constraints  of  the  problem 
are  never  violated.  Therefore,  it  is  necessary  to  pick  starting  values  of  the  design  parameters 
that  do  not  violate  any  of  the  constraints.  This  is  achieved  by  means  of  a  fully  stressed  design 
that,  if  necessary,  is  scaled  up  so  that  the  displacement  constraints  are  satisfied.  A  fully 
stressed  design  for  multiple  loads  is  that  design  in  which  every  element  is  subjected  to  its 
maximum  allowable  stress  in  at  least  one  load  condition.  The  design  is  accomplished  by 
assuming  that  the  stress  in  each  element  is  affected  only  by  its  size  and  that  there  is  no 
cross  effect  due  to  static  indeterminacy  between  the  elements.  The  element  sizes  are  then 
proportioned  to  give  a  fully  stressed  design.  Because  there  is  a  cross  effect,  the  fully 
stressed  design  is  not  achieved  immediately.  However,  repeated  applications  of  this  pro¬ 
cedure  usually  lead  to  rapid  convergence.  In  practice,  because  of  the  need  to  keep  away  from 
the  constraints,  lower  values  of  the  stress  constraints  are  used  for  the  design,  typically  0.95 
times  the  allowable  stresses. 

BASIC  METHOD 

Two  slightly  different  methods  can  be  adopted  for  reducing  the  scaling  factors  r  ,  during 

the  course  of  the  optimization.  The  first  approach  is  to  keep  r  constant  and  find  the  minimum 

c 

of  the  function  F.  Then  reduce  rc  and  find  the  next  minimum,  etc.  The  second  approach  is  to 
reduce  rQ  with  the  progress  of  the  minimization,  because  it  is  pointless  to  find  the  exact 
minimum  for  every  value  of  rc  since  the  exact  minimum  is  only  required  for  the  final  value  of 
rc-  Because  previous  workers  had  used  the  first  approach,  it  was  decided  to  explore  the 
second  approach. 
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IMPROVED  METHOD 

After  coding  of  the  unconstrained  minimization  using  the  created  response  surface  approach 
with  Rosenbrock’s  search,  a  number  of  simple  problems  were  used  to  check  the  operation  of 
the  program.  Although  the  methods  used  yielded  minima,  it  was  felt  that  considerable  improve¬ 
ments  in  operational  efficiency  could  be  produced.  To  this  end  three  modifications  in  principle 
were  introduced,  all  of  which  produced  significant  reductions  in  computational  expense. 

1.  Extrapolations  Techniques.  When  using  the  created  response  surface  approach  as 

discussed  previously,  the  weighting  factor  r  for  the  penalty  function  P  is  assumed  to  have 

c  c 

some  artibrary  initial  value.  This  factor  has  been  selected  to  make  the  value  of  the  penalty 

initially  equal  to  the  value  of  the  merit  function  at  the  starting  point.  The  factor  r  is  then 

c 

reduced  stepwise  until  further  reduction  produces  no  appreciable  decrease  in  the  merit 
function  W. 

Such  a  process  may  require  a  considerable  number  of  iterations.  To  accelerate  the  pro¬ 
cedure,  an  extrapolation  method  was  developed.  The  extrapolationprocedure  was  based  on  the 
assumption  that  each  component  of  the  minimum  of  the  function  F(DV,  rc)  can  be  expanded  in 
a  power  series  in  r  A  two  term  series  was  used 

'/2 

D V  lrc  )  =  a0  +■  a  ,  rc  (7) 

The  initial  weighting  factor  r  was  chosen  so  that  the  penalty  function  was  equal  to  the  weight. 

c 

Three  values  of  r  were  used,  the  value  of  r  being  reduced  by  a  factor  of  4  after  each  min- 
c  c 

imization.  Substitution  of  the  values  of  a  parameter  at  a  consecutive  minimum  for  two  values  of 

rQ  defined  the  constants  aQ  and  a1.  Equation?  was  then  used  to  estimate  the  values  of  the  design 

parameters  (DV.)  for  the  next  weighting  factor  r  .  Equation  7  also  was  used  to  extrapolate  to 
1  c 

the  minimum  as  the  weighting  factor  r  tends  to  zero  since  by  Equation  (7) 

c 

DV  (r  )'=  a  as  r  —  o  (85 

co  c 

Finally,  we  note  that,  for  the  extrapolation  process,  Fiacco  and  McCormick  stressed  the 
importance  of  an  accurate  evaluation  of  the  minimum  for  each  value  of  r  . 
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2.  Truncated  Search,  It  was  noted  that  during  the  search  in  a  chosen  direction  of  the 
Rosenbrock  method,  the  third  step  after  two  successes  usually  proved  unproductive.  An  ex¬ 
amination  of  Rosenbrock’ s  original  results  showed  an  improvement  in  the  minimization  of  a 
function  for  a  fixed  number  of  trials  as  the  factor  ft  +  was  increased  from  1  to  5.  It  was 
conjectured  that  the  improvement  was  brought  about  by  the  reduction  of  the  number  of  trials 
required  in  the  search  along  each  of  the  chosen  directions.  It  was  therefore  decided  to 
truncate  the  search  after  two  successful  steps.  Similarly,  it  was  observed  that  a  step,  follow¬ 
ing  two  failures  and  a  success,  also  proved  unproductive  and  the  search  was  also  truncated 
after  the  successful  step. 

3.  Linearization  Methods.  Much  time  in  any  optimization  process  is  taken  up  by  the 
repeated  complete  reanalyses  that  are  necessary  after  every  change  of  design  parameters. 
Although  the  response  characteristics  (stresses,  displacements)  are  strictly  nonlinear  functions 
of  all  the  possible  design  variables,  it  is  practical  to  regard  the  rates  of  change  of  these 
responses  to  be  sensibly  constant  for  small  changes  in  the  design  parameters.  That  is,  the 
continuously  curved  response  characteristics  may  be  assumed  to  be  stepwise  linear.  This  may 
lead  to  slight  inaccuracies,  especially  when  step  sizes  are  large.  On  the  other  hand,  on 
search  procedures  great  accuracy  is  not  necessary  (and  may  be  needlessly  expensive  to 
obtain)  in  early  stages  when  remote  from  the  optimum.  Near  the  optimum  the  step  sizes 
generally  become  very  small  and  the  linearization  concept  is  highly  accurate. 
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SECTION  IV 
EXAMPLE  PROBLEMS 


INITIAL  ATTEMPT 

Two  problems  were  investigated,  the  first  that  of  the  three  bar  truss  studied  by  Schmit 

and  Mallett  (Reference  12)  and  shown  in  Figure  7.  Table  1  gives  the  three  sets  of  applied 

loads.  A  fully  stressed  design  was  first  found  and  the  value  of  r  was  selected  so  that  the 

c 

ratio  of  the  penalty  function  to  the  weight  was  one  to  ten.  A  function  minimization  was  then 

carried  out  with  the  r  being  reduced  to  0.7  of  its  value  after  each  stage.  The  result  of 

c 

8.717  lb  was  obtained  by  Schmit  and  Mallett  and  8.720  lb  by  Gellatly  et.  al.  (Reference  2). 
The  second  problem  was  that  of  the  25-bar  truss. 

The  next  example  chosen  is  that  of  the  25-bar  truss  studied  by  Fox  and  Schmit  (Reference 
13).  Fox  and  Schmit  included  buckling  constraints  and  used  tube  diameter  and  thickness  as  the 
design  variables.  The  cross-sectional  area  of  the  circular  tubes  are  used  here  as  the  design 
variables.  The  Euler  criteria  are  included  as  stress  limits  for  each  member.  The  stress 
limits  unless  modified  by  the  Euler  buckling  criteria  are  specified  to  be  ±40,000  psi.  The 
displacement  limits  for  each  displacement  component  of  any  node  in  the  truss  are  ±  0.35  in. 
The  truss  is  shown  on  Figure  8.  Symmetry  is  imposed  about  the  XZ  and  YZ  plane 


100 


A  FFDL-TR- 68-150 


Figure  8.  Transmission  Tower 
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TABLE  I 

LOADS  ON  THREE -BAR  TRUSS 


Load 

Condition 

P 

X 

P 

y 

(EaAT)1 

(Ea  At)  2 

(EaAT)3 

1 

105lb 

0 

6500  psi 

13,000  psi 

19,500  psi 

2 

-9.5459  x  10Alb 

-9.5459  x  104lb 

19,500  psi 

13,000  psi 

6500  psi 

3 

8.195  x  104lb 

-5.7358  x  104lb 

0 

0 

0 

TABLE  2 

LOADS  ON  25 -BAR  TRUSS 


Load 

Nodal 

Direction  of  Load 

Condition 

Point 

X 

Y 

Z 

1 

1000 

10,000 

-5,000 

2 

0 

10,000 

-5,000 

1 

3 

500 

0 

0 

6 

500 

0 

0 

1 

0 

20,000 

-5,000 

2 

2 

0 

-20,000 

-5,000 
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by  means  of  a  linking  feature  that  forms  the  following  groups  of  cross-sectional  areas: 


A  A  = 

1  *  2 

A3=  A4 

=  A  A 

II 

> 

-m 

=  A  -  A 

8  M  9 

,  A 

10 

A„ 

■  A  |g 

A  -A 

14  M  1  5 

=  A  1  6  1 

A  A 

IT  *  18 

sA,* 

< 

II 

o 

CSl 

< 

II 

21 

and 

A22 

=  A  23 

The  truss  is  only  loaded  at  two  nodal  points.  The  imposed  loading  on  the  truss  is  given  in 
Table  2.  This  second  example  was  constructed  so  that  the  displacement  constraints  were 
active.  When  the  same  procedure  that  was  applied  to  the  three-bar  truss  was  applied  to  the 
second  example,  the  function  F  proved  difficult  to  minimize.  A  minimum  was  only  obtained 
after  30  Rosenbrock  stages  and  required  about  20  minutes  of  IBM  7090  time.  Minimum  weight 
obtained  was  555  lb.  This  may  be  compared  with  a  weight  of  570  lb  by  Fox  and  Schmit 
(Reference  13)  and  551  lb  by  Gellatly  (Reference  3).  The  differences  between  first  and  the  last 
weight  are  though  to  be  due  to  the  different  accuracy  criteria. 


However,  it  is  relevant  to  note  that  progress  from  the  570-lb  weight  to  555-lb  took  about 
a  half  of  the  computing  time. 


IMPROVEMENT  OF  BASIC  METHOD 


The  introduction  of  the  improved  procedures  resulted  in  a  significant  reduction  of  the 
computing  time  required  to  minimize  the  twenty-five  bar  truss. 

1.  Extrapolation  Technique.  The  extrapolation  technique  resulted  in  an  extrapolated 

minimum  weight  of  556  lb  (minimum  weight  at  last  value  of  r  =  558  lb).  The  number  of  stages 

c 

in  the  Rosenbrock  minimization  and  the  computing  time  were  reduced  by  a  factor  of  two. 

2.  Truncated  Search.  The  truncated  search  procedures  brought  the  average  number  of 
steps  in  each  search  direction  from  four  to  three,  which  saved  about  a  quarter  of  the  computing 
time  and  the  minimum  weight  was  not  affected. 
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3.  Linearized  Procedures.  Before  the  start  of  each  stage,  the  rate  of  change  of  the 
stresses  and  displacements  with  respect  to  the  step  length  in  each  of  the  chosen  directions 
were  evaluated  by  a  finite  difference  procedure.  Since  an  average  of  three  function  evaluations 
are  required  in  each  search  direction,  this  linearized  approach  reduced  the  number  of  stress 
analyses  required  at  each  stage  by  a  third  of  the  original  number  and  reflected  itself  in  a 
halving  of  the  computing  time.  The  final  optimization  with  all  the  improvements  incorporated 
required  3,6  minutes  of  IBM  7090  time.  The  progress  in  reducing  the  computing  times  is 
summarized  in  Table  3, 


Finally,  it  is  estimated  that  a  further  halving  of  the  computing  time  can  be  achieved  by 
using  the  well-known  techniques  of  elastic  redesign  (see  for  instance  Gellatly  and  Gallagher, 
Reference  14)  which  make  use  of  the  total  differential  of  the  equations  of  equilibrium.  The 
estimated  time  of  1.8  minutes  IBM  7090  is  of  the  same  order  as  the  time  of  1.2  minutes 
UNIVAC  1107  estimated  by  Fox  and  Schmit  for  the  solution  of  this  problem  by  the  integrated 
approach  to  structural  synthesis.  However,  it  should  be  noted  that  this  suggested  improvement 
requires  a  doubling  in  the  size  of  the  computer  store,  which  may  in  fact  be  too  stringent  a 
requirement. 

The  second  interesting  observation  of  the  minimization  procedure  is  that  the  search 
along  the  direction  provides  an  order  of  magnitude  improvement  over  the  search  along  the 
other  directions.  It  is  as  if  the  only  purpose  of  the  search  along  the  other  directions  is  to 
explore  and  set  up  a  new  best  direction  for  P^. 

DISCRETE  DESIGN 

1.  Example  1,  Three-Bar  Truss. 

The  same  three-bar  truss  was  used  as  a  first  example  for  discrete  design.  The  same  load 

conditions  were  used.  Four  discrete  designs  were  produced.  Sections  were  allowed  to  vary  in 

2 

increments  of  0.2,  0.3,  0.4  and  0.5  in.  ,  in  turn  and  starting  from  its  lowest  permissible  value 
of  0.001.  Sufficient  sections  were  specified  so  that  the  discrete  design  did  not  take  on  the 
highest  specified  value. 

2 

To  achieve  the  design  with  discrete  variations  of  0.5  in.  ,  it  was  necessary  to  force  back 
element  3  and  then  element  1  in  turn. 
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TABLE  3 


IMPROVEMENTS  IN  COMPUTING  TIME 


Method 

Min.  Weight 
lb 

Comp.  Time 

IBM  7090  min. 

Stages 

Initial  Method 

555 

20 

30 

Extrapolation 

556 

11 

15 

Extrapolation  and  Truncated 

Search 

556 

8 

14 

Extrapolation,  Truncated 

Search  and  Linearized 

Change 

555 

3.6 

14 

TABLE  4 

DISCRETE  DESIGN  OF  THREE -BAR  TRUSS 


Increments 
in  Areas , 
in.  ^ 

7c,  Penalty 
of  Discrete 

Minimum 

Weight 

Cross 

-  Sectional  Area 

in.  2 

Design 

lb 

Element  1 

... 

Element  2 

Element  3 

Continuous 

0 

8.717 

1.113 

0.577 

1.544 

0.2 

1 

8.791 

1.195 

0.400 

1.600 

0.3 

11 

9.782 

1.200 

0.600 

1.800 

0.4 

1 

8.791 

1.195 

0.400 

1.600 

0.5 

28 

11.008 

1.500 

0.500 

2.000 

105 


AFFDL-TR-68-150 


The  results  are  presented  in  Table  4.  It  can  be  seen  that  the  design  for  sections  with 
increments  in  area  of  0.4  in.2  is  the  same  as  that  for  0.2  in.  .  Thus  the  weight  of  the  discrete 
designs  do  not  increase  monotonically  but  are  somewhat  dependent  on  the  distance  of  travel 
required  to  reach  a  discrete  design  from  the  minimum  continuous  design. 

2.  Example  2,  Twenty- five  Bar  Truss. 

The  twenty-five  bar  truss  shown  in  Figure  8  was  used  as  a  second  example  of  discrete 
design.  Two  discrete  designs  were  effected.  Sections  were  allowed  to  vary  in  increments  of 
0.4  and  0.8  in.2. 

The  results  of  the  discrete  designs  are  shown  in  Tables  5  and  6.  Table  5  gives  the  weight 
of  the  optimum  designs.  It  also  gives  details  on  which  specified  sections  had  to  be  removed 
from  the  list  in  order  to  achieve  the  discrete  design.  Table  6  gives  the  cross-sectional  areas 
obtained  in  the  optimum  design.  It  will  be  noted  that  in  the  cross-sectional  areas,  A1  moves  a 
considerable  distance  away  from  its  value  at  the  continuous  minimum.  It  was  this  possibility 
that  prevented  the  use  of  a  simpler  search  through  all  the  combinations  of  the  discrete  sections 
adjacent  to  the  continuous  design  parameter  values.  This  large  change  appears  to  be  due  to  the 
design  beinginsensitivetothedesignparameter  A^  Because  improvements  in  the  minimization 
procedure  were  made  at  the  same  timeasthe  above  results  were  being  obtained,  it  is  difficult 
to  quote  typical  computing  times  for  the  analysis.  However,  it  was  observed  that  on  average 
12-15  Rosenbrock  stages  were  required  to  reach  a  discrete  design  in  the  twenty- five-bar  truss. 


TABLE  5 

RESULTS  OF  DISCRETE  OPTIMIZATION,  25-BAR  TRUSS 


Increments 
in  Sectional 
Areas,  in. 2 

Weight  of  Discrete 
Design, 
lb 

Number  of 
Sections  to 

Be  Discretized 

Element  No.  of 
Which  Deletion 
Is  Made 

Element  Size 
Deleted  from 
List,  in. ^ 

Continuous 

554.9 

0.4 

595.4 

19 

21 

1.6 

8 

5 

2.0 

1 

1 

1.2 

1 

1 

1.6 

0.8 

642.4 

11 

22 

2.4 

1 

1 

0.0111 (min. ) 
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TABLE  6 


OPTIMAL  CROSS-SECTION  AREAS  FOR  DISCRETE  DESIGN 


Increments 
in  Specified 
Sections , 
in. 2 

Area  for  Elements. 

2 

in. 

A1 

A2 

A6 

A10 

A12 

A14 

A18 

A22 

Continuous 

0.189 

2.142 

2.488 

0.038 

0.084 

0.694 

1.866 

2.771 

0.4 

2.009 

2.400 

2.400 

0.011 

0.011 

0.800 

2.000 

2.800 

0.8 

1.56 

2.400 

2.400 

— 

0.011 

0.011 

0.800 

2.400 

3.200 

X 


Figure  9.  Penalty  Due  to  Discrete  Design 
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Finally,  Figure  9  shows  the  change  in  weight  of  the  otpimum  design  with  increase  in  the 
size  of  the  increments  in  the  specified  cross-sectional  areas.  The  increase  in  weight  is  shown 
as  a  percentage  of  the  continuous  design  while  the  size  of  the  increment  is  shown  as  a  fraction 
of  the  maximum  design  section  used  in  the  continuous  design. 

Although  the  results  do  not  increase  regularly,  the  trend  is  as  expected,  i.e.,  the  optimum 
weight  increases  in  the  size  of  increments  in  the  specified  cross-sectional  area. 


CONCLUSIONS 

The  Created  Response  Surface  Technique  was  successfully  applied  to  some  problems  of 
structural  optimization  with  multi-load  conditions.  The  original  method  was  modified  to  take 
advantage  of  the  interaction  between  the  optimization  procedure  and  the  response  of  the 
structure  to  changes  in  sectional  areas.  This,  when  coupled  with  the  r  extrapolation  procedure, 
resulted  in  considerable  savings  in  computing  time. 

Discrete  design  was  effected  by  introducing  a  penalty  function  which  only  vanished  when 
the  variables  were  at  the  specified  discrete  values. 
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